CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering

Intrinsic image decomposition is a challenging, long-standing computer vision problem for which ground truth data is very difficult to acquire. We explore the use of synthetic data for training CNN-based intrinsic image decomposition models, then applying these learned models to real-world images. To that end, we present \ICG, a new, large-scale dataset of physically-based rendered images of scenes with full ground truth decompositions. The rendering process we use is carefully designed to yield high-quality, realistic images, which we find to be crucial for this problem domain. We also propose a new end-to-end training method that learns better decompositions by leveraging \ICG, and optionally IIW and SAW, two recent datasets of sparse annotations on real-world images. Surprisingly, we find that a decomposition network trained solely on our synthetic data outperforms the state-of-the-art on both IIW and SAW, and performance improves even further when IIW and SAW data is added during training. Our work demonstrates the suprising effectiveness of carefully-rendered synthetic data for the intrinsic images task.Comment: Paper for 'CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering' published in ECCV, 201

Joint Learning of Intrinsic Images and Semantic Segmentation

Semantic segmentation of outdoor scenes is problematic when there are variations in imaging conditions. It is known that albedo (reflectance) is invariant to all kinds of illumination effects. Thus, using reflectance images for semantic segmentation task can be favorable. Additionally, not only segmentation may benefit from reflectance, but also segmentation may be useful for reflectance computation. Therefore, in this paper, the tasks of semantic segmentation and intrinsic image decomposition are considered as a combined process by exploring their mutual relationship in a joint fashion. To that end, we propose a supervised end-to-end CNN architecture to jointly learn intrinsic image decomposition and semantic segmentation. We analyze the gains of addressing those two problems jointly. Moreover, new cascade CNN architectures for intrinsic-for-segmentation and segmentation-for-intrinsic are proposed as single tasks. Furthermore, a dataset of 35K synthetic images of natural environments is created with corresponding albedo and shading (intrinsics), as well as semantic labels (segmentation) assigned to each object/scene. The experiments show that joint learning of intrinsic image decomposition and semantic segmentation is beneficial for both tasks for natural scenes. Dataset and models are available at: https://ivi.fnwi.uva.nl/cv/intrinsegComment: ECCV 201

Accidental Pinhole and Pinspeck Cameras

We identify and study two types of “accidental” images that can be formed in scenes. The first is an accidental pinhole camera image. The second class of accidental images are “inverse” pinhole camera images, formed by subtracting an image with a small occluder present from a reference image without the occluder. Both types of accidental cameras happen in a variety of different situations. For example, an indoor scene illuminated by natural light, a street with a person walking under the shadow of a building, etc. The images produced by accidental cameras are often mistaken for shadows or interreflections. However, accidental images can reveal information about the scene outside the image, the lighting conditions, or the aperture by which light enters the scene.National Science Foundation (U.S.) (CAREER Award 0747120)United States. Office of Naval Research. Multidisciplinary University Research Initiative (N000141010933)National Science Foundation (U.S.) (CGV 1111415)National Science Foundation (U.S.) (CGV 0964004

Chromatic Illumination Discrimination Ability Reveals that Human Colour Constancy Is Optimised for Blue Daylight Illuminations

The phenomenon of colour constancy in human visual perception keeps surface colours constant, despite changes in their reflected light due to changing illumination. Although colour constancy has evolved under a constrained subset of illuminations, it is unknown whether its underlying mechanisms, thought to involve multiple components from retina to cortex, are optimised for particular environmental variations. Here we demonstrate a new method for investigating colour constancy using illumination matching in real scenes which, unlike previous methods using surface matching and simulated scenes, allows testing of multiple, real illuminations. We use real scenes consisting of solid familiar or unfamiliar objects against uniform or variegated backgrounds and compare discrimination performance for typical illuminations from the daylight chromaticity locus (approximately blue-yellow) and atypical spectra from an orthogonal locus (approximately red-green, at correlated colour temperature 6700 K), all produced in real time by a 10-channel LED illuminator. We find that discrimination of illumination changes is poorer along the daylight locus than the atypical locus, and is poorest particularly for bluer illumination changes, demonstrating conversely that surface colour constancy is best for blue daylight illuminations. Illumination discrimination is also enhanced, and therefore colour constancy diminished, for uniform backgrounds, irrespective of the object type. These results are not explained by statistical properties of the scene signal changes at the retinal level. We conclude that high-level mechanisms of colour constancy are biased for the blue daylight illuminations and variegated backgrounds to which the human visual system has typically been exposed

A Longitudinal Study of Medicaid Coverage for Tobacco Dependence Treatments in Massachusetts and Associated Decreases in Hospitalizations for Cardiovascular Disease

Thomas Land and colleagues show that among Massachusetts Medicaid subscribers, use of a comprehensive tobacco cessation pharmacotherapy benefit was followed by a substantial decrease in claims for hospitalizations for acute myocardial infarction and acute coronary heart disease

Marine Macroalgal Diversity Assessment of Saba Bank, Netherlands Antilles

Background: Located in the Dutch Windward Islands, Saba Bank is a flat-topped seamount (20–45 m deep in the shallower regions). The primary goals of the survey were to improve knowledge of biodiversity for one of the world’s most significant, but little-known, seamounts and to increase basic data and analyses to promote the development of an improved management plan. Methodology/Principal Findings: Our team of three divers used scuba to collect algal samples to depths of 50 m at 17 dive sites. Over 360 macrophyte specimens (12 putative new species) were collected, more than 1,000 photographs were taken in truly exceptional habitats, and three astonishing new seaweed community types were discovered. These included: (1) ‘‘Field of Greens’ ’ (N 17u30.6209, W63u27.7079) dominated by green seaweeds as well as some filamentous reds, (2) ‘‘Brown Town’ ’ (N 17u28.0279, W63u14.9449) dominated by large brown algae, and (3) ‘‘Seaweed City’ ’ (N 17u26.4859, W63u16.8509) with a diversity of spectacular fleshy red algae. Conclusions/Significance: Dives to 30 m in the more two-dimensional interior habitats revealed particularly robust specimens of algae typical of shallower seagrass beds, but here in the total absence of any seagrasses (seagrasses generally do not grow below 20 m). Our preliminary estimate of the number of total seaweed species on Saba Bank ranges from a minimum of 150 to 200. Few filamentous and thin sheet forms indicative of stressed or physically disturbed environments were observed. A more precise number still awaits further microscopic and molecular examinations in the laboratory. The expedition, while intensive, has only scratched the surface of this unique submerged seamount/atoll

Rapid Assessment of Octocoral Diversity and Habitat on Saba Bank, Netherlands Antilles

Saba Bank is a large submerged platform (∼2200 km2), average depth 30 m, located 4 km southwest of Saba Island in Netherlands Antilles, Caribbean Sea. Ships traveling to and from oil terminals on nearby St. Eustatius routinely anchor on the Bank, damaging benthic megafauna. Gorgonian octocorals are vulnerable to anchor damage, and they are common and conspicuous in shallow water (15–50 m) around the banks. This prompted a rapid assessment of octocoral habitat and diversity. The primary objectives were to estimate total species richness and to characterize habitats vis a vis gorgonians. Landsat imagery and multibeam bathymetry were employed to identify random sites for quantitative transects. A Seabotix LBV200L remotely operated vehicle (ROV) and SCUBA were used to collect and survey to 130 m. A total of 14 scuba dives and 3 ROV dives were completed in 10 days. During that time, 48 octocoral species were collected, including two likely undescribed species in the genera Pterogorgia and Lytreia. Gorgonian richness was exceptional, but not all species were collected, because the species accumulation curve remained steeply inclined after all surveys. Two shallow-water gorgonian habitat types were identified using multidimensional scaling and hierarchical cluster analyses: 1) a high diversity, high density fore-reef environment characterized by Eunicea spp., Gorgonia spp., and Pseudopterogorgia spp. and 2) a low diversity, low density plateau environment characterized by Pseudopterogorgia acerosa, Pterogorgia guadalupensis, and Gorgonia mariae. The analyses support hypotheses of broad (∼15 km) habitat homogeneity (ANOSIM, P>0.05), but a significant difference between fore-reef and plateau environments (ANOSIM, P<0.05). However, there was some indication of habitat heterogeneity along the 15 km study section of the 50 km platform edge along the southeast rim. Our results highlight the complexity and biodiversity of the Saba Bank, and emphasize the need for more scientific exploration

Rural waste generation: a geographical survey at local scale

"The paper examines the per capita waste generation rates from from rural areas of Neamț County (Romania) using thematic cartography. Geographical approach of this issue is difficult because the lack of a geostatistic database at commune scale. Spatial analysis of waste indicators reveals several disparities between localities. Comparability of data between communes located in various geographical conditions must be carrefully made according to local waste management systems. Several dysfunctionalities are outlined in order to compare these results, on the one hand, between localities and on the one hand, between recent years. Geographical analysis of waste generation rates is imperative for a proper monitoring of this sector. Data from 2009, 2010 and 2012 shows that rural waste management is in a full process of change towards a more organized, stable and efficient system." (author's abstract

Texture variations suppress suprathreshold brightness and colour variations

Discriminating material changes from illumination changes is a key function of early vision. Luminance cues are ambiguous in this regard, but can be disambiguated by co-incident changes in colour and texture. Thus, colour and texture are likely to be given greater prominence than luminance for object segmentation, and better segmentation should in turn produce stronger grouping. We sought to measure the relative strengths of combined luminance, colour and texture contrast using a suprathreshhold, psychophysical grouping task. Stimuli comprised diagonal grids of circular patches bordered by a thin black line and contained combinations of luminance decrements with either violet, red, or texture increments. There were two tasks. In the Separate task the different cues were presented separately in a two-interval design, and participants indicated which interval contained the stronger orientation structure. In the Combined task the cues were combined to produce competing orientation structure in a single image. Participants had to indicate which orientation, and therefore which cue was dominant. Thus we established the relative grouping strength of each cue pair presented separately, and compared this to their relative grouping strength when combined. In this way we observed suprathreshold interactions between cues and were able to assess cue dominance at ecologically relevant signal levels. Participants required significantly more luminance and colour compared to texture contrast in the Combined compared to Separate conditions (contrast ratios differed by about 0.1 log units), showing that suprathreshold texture dominates colour and luminance when the different cues are presented in combination

Kiwi Forego Vision in the Guidance of Their Nocturnal Activities

BACKGROUND: In vision, there is a trade-off between sensitivity and resolution, and any eye which maximises information gain at low light levels needs to be large. This imposes exacting constraints upon vision in nocturnal flying birds. Eyes are essentially heavy, fluid-filled chambers, and in flying birds their increased size is countered by selection for both reduced body mass and the distribution of mass towards the body core. Freed from these mass constraints, it would be predicted that in flightless birds nocturnality should favour the evolution of large eyes and reliance upon visual cues for the guidance of activity. METHODOLOGY/PRINCIPAL FINDINGS: We show that in Kiwi (Apterygidae), flightlessness and nocturnality have, in fact, resulted in the opposite outcome. Kiwi show minimal reliance upon vision indicated by eye structure, visual field topography, and brain structures, and increased reliance upon tactile and olfactory information. CONCLUSIONS/SIGNIFICANCE: This lack of reliance upon vision and increased reliance upon tactile and olfactory information in Kiwi is markedly similar to the situation in nocturnal mammals that exploit the forest floor. That Kiwi and mammals evolved to exploit these habitats quite independently provides evidence for convergent evolution in their sensory capacities that are tuned to a common set of perceptual challenges found in forest floor habitats at night and which cannot be met by the vertebrate visual system. We propose that the Kiwi visual system has undergone adaptive regressive evolution driven by the trade-off between the relatively low rate of gain of visual information that is possible at low light levels, and the metabolic costs of extracting that information